Temperature chaos, rejuvenation and memory in Migdal-Kadanoff spin glasses 
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We use simulations within the Migdal-Kadanoff approach to probe the scales relevant for reju- 
venation and memory in Ising spin glasses. First we investigate scaling laws for domain wall free 
energies and extract the chaos overlap length £(T,T'). Then we perform out of equilibrium simula- 
tions that follow experimental protocols. We find that: (1) a rejuvenation signal arises at a length 
scale significantly smaller than £(T, T'); (2) memory survives even if equilibration goes out to length 
scales larger than £(T,T'). Theoretical justifications of these phenomena are then considered. 

PACS numbers: 75.10.Nr, 05.50.+q, 75.40.Gb, 75.40.Mg 



Two of the most spectacular experimental properties 
of spin glasses are "rejuvenation" and "memory" (see Q 
and references therein) . Both are out of equilibrium phe- 
nomena that arise in slowly relaxing systems |2|, so un- 
derstanding such properties is of great importance. Qual- 
itatively, when a spin glass approaches equilibrium, it 
"ages" , reducing its susceptibility, that is its response to 
external perturbations. However, if one lowers the tem- 
perature after aging, one sees a restart or rejuvenation 
of the susceptibility, while memory of the previous aging 
can be retrieved upon heating back! From a theoreti- 
cal point of view, rejuvenation must appear if there is 
"temperature chaos" , that is if the spin polarizations at 
two temperatures T and T" are decorrelated jjj beyond a 
characteristic length scale £(T,T'). Moreover, tempera- 
ture chaos is compatible with memory through the pres- 
ence of ghost domains Q. However, temperature chaos 
is not clearly seen in Monte Carlo simulations 0, and 
estimates of the chaos length £(T, T') give very large val- 
ues 0, seemingly much larger than the length scale £r 
on which rejuvenation appears experimentally. 

Our purpose here is to find the scales relevant for re- 
juvenation and memory in Ising spin glasses. We use 
Migdal-Kadanoff (MK) lattices whose exact renormaliza- 
tion |8| allows one to measure equilibrium quantities on 
large length scales. Furthermore, it also allows for ef- 
ficient dynamical simulations at very long time scales, 
enabling us to extract the length £r which is relevant 
for rejuvenation. The outline of the paper is as follows. 
First, we define the MK lattices. Second we investigate 
equilibrium chaos: after extracting £(T, T"), we determine 
how the distribution of two-temperature overlaps changes 
with lattice size. Third, we show how (renormalized) dy- 
namics can be used to probe rejuvenation and memory 
on very long length and time scales. Finally, we perform 
out of equilibrium measurements that follow standard 
experimental protocols; these signal rejuvenation even if 
temperature chaos is very weak and show that memory 
is preserved even if the equilibrated length scale is much 
larger than £(T,T'). The current theoretical frameworks 



(see and Q) partially account for these properties 

as explained in the discussion section. 

The model - We consider MK lattices following the 
standard real space renormalization group approxima- 
tion to the Edwards Anderson (EA) model [ll]. The 
recursive construction of such hierarchical lattices is de- 
scribed in Fig. ^ edges are replaced by 26 edges so the 
"length" of the lattice is multiplied by 2. We call gener- 
ation "level" the order of the recursion and G the total 
number of these. Then the lattice length L is 2 G and the 
number of bonds is (26) G (which is also roughly the num- 
ber of sites); one can thus identify 1 + In 6/ In 2 with the 
dimension of space on such a lattice. When all the edges 
are constructed, each is assigned a random coupling J^ . 
Similarly, on each site i we put an Ising spin Si = ±1. 
The Hamiltonian is 



Hj({Si}) 



<ij> 



i j Si Sj 



(i) 



where the sum is over all the nearest neighbor spins of 
the lattice. The MK approach leads to accurate values 
for the spin glass stiffness exponent and for the lower 
critical dimension; furthermore it exhibits temperature 
chaos 0, 0, El ■ We thus feel it is a good starting point 
for studying the mechanisms of rejuvenation and memory 
in spin glasses. All of the work presented here will be for 
three dimensions (6 = 4) with couplings Jij taken from 
a Gaussian of mean and width 1. The model then 
undergoes a spin glass transition at T c » 0.896 fl3j |. 

Chaos in domain wall free energies - Bray and 
Moore 0] were the first to study the temperature depen- 
dence of domain wall free energies. Call Ff w the free 
energy of a domain wall for a given disorder obtained 





FIG. 1: Construction of a hierarchical MK lattice (b — 2). 
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by forcing the outer-most spins of the MK lattice to be 
anti-parallel instead of parallel. (Fp w /2 is the effective 
coupling between these spins.) When L grows, Fj )W (T) 
and Ff w (T') become decorrelated if T ^ T', so the lin- 
ear correlation coefficient fl3| 



G DW (L,T,T') = 



*(T>) 



(2) 



goes to zero at large L. (In this definition, • • • is the 
disorder average, a is the standard deviation of Ff w , 
and we have used the fact that Fj" w = 0.) We are not 
aware of any study describing how G DW vanishes when 
L grows. We thus computed Ff w for a large number of 
MK lattices and then estimated C DW . Defining £(T,T') 
as the value of L where G DW = 1/e, our data fall on a 
single curve when using the scaling variable L/£(T, T'): 



G DW (L,T,T') ~ f[L/£(T, T')\ 



(3) 



This is illustrated in Fig. El As expected, £(T . T' ) goes as 
\T — where £ is the chaos exponent 1 121 : for our 

system, £ = d s /2 — 9 w 0.745. As shown in ref. |l3(, in the 
weak chaos limit L < t{T,T'), 1-G DW « [L/j?(T, T')] 2C . 
In the strong chaos limit, L 3> £(T,T'), we find that the 
scaling function /(a;) behaves as exp(— a; Q ), with a = 
1.18 ±0.02. 

TTie two temperature P(q) - Beyond the length scale 
£(T,T'), domain wall free energies will often have dif- 
ferent signs at T and T'. As a consequence, the spin 
orderings will be different as can be made quantitative 
by considering two-temperature "overlaps" . Let q be the 
overlap of two configurations C and C taken in equilib- 
rium (at T for C and at T' for C). Temperature chaos im- 
plies that PxT'(q), the disorder averaged distribution of 
such overlaps, tends towards a delta function in 0. How- 
ever, this behavior has not been seen in the Sherrington- 
Kirkpatrick (SK) model nor in EA spin glasses |5j, It 
is therefore interesting to see how Ptt 1 (q) behaves in MK 
spin glasses where temperature chaos arises for sure and 
£{T, T) is known. 
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In Fig. |3 we show Ptt'(q) determined numerically in 
the case T = 0.7, T = 0.4 for which £(T,T') = 2 7 8 . 
When L = 2 G < 2 6 , P TT '(q) for T ^ T and T = T' are 
similar: there is a main peak at a "large" value of q and a 
broad tail towards lower q; furthermore the peak position 
shifts to lower q with increasing G. The differences from 
the case T = T" are that the distributions have a shoulder 
and also a clear local maximum at q = 0. This behavior 
is close to what has been observed in the SK model @|. 
Now for larger G's, the shoulder takes over, and starting 
with G = 9, PTT'{q) has a single peak, located at q = 0. 
Note that G = 6 corresponds to very large L and so the 
asymptotic behavior is not likely to be seen soon in the 
EA model. 

Exploiting renormalization for dynamical quantities — 
Temperature chaos has often been used to explain rejuve- 
nation, but temperature chaos is not necessary for reju- 
venation. In particular, rejuvenation arises in generalized 
random energy models However, a study ^(J nas 

suggested that the influence of temperature chaos may 
be visible even if the domain size (or equilibrated length 
scale) reached experimentally is much smaller than the 
overlap length £(T, T 1 ). Thus we ask here what is the re- 
lation between the (equilibrium) overlap length and the 
length scale Ir which is relevant for rejuvenation. In the 
framework of Migdal-Kadanoff lattices, we can address 
this question because one may go to long time scales as 
follows. 

Suppose we focus on a time window t mul < t < t max . 
Between t = and t = t mul the system has had 
time to equilibrate up to the length scale J(i m m)i essen- 
tially all out of equilibrium physics comes from larger 
length scales. On the MK lattice, this means that the 
spins whose generation "level" is larger than G m i n (with 
2G-G min _ /(£ min )) are in local equilibrium; the other 
spins have dynamics that is well described by the effec- 
tive Hamiltonian at the generation G m i n . In practice, 
we implement this idea as follows. First we generate a 
large number of bare couplings from a Gaussian of mean 
and width 1. Then, we use renormalization to produce 
an ensemble of effective couplings. This process is iter- 
ated NRG = G — G m in times. (NRG is for the number 
of renormalization group transformations.) The final ef- 



lnflj-log [1(T,T-AT) ] 




FIG. 2: Plot of ln{— ln[C DW (L, T, T — AT)]} to show the data FIG. 3: Two-temperature overlap probability distribution 



collapse. The lines are the weak and strong chaos limits. 



P TT '(q) when T = 0.7, T' = 0.4; L — 2 
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fective couplings are then used to create a MK lattice 
of size 2 Gmin . After that, we simply do standard Monte 
Carlo. Note that one Monte Carlo Sweep (MCS) on the 
renormalized lattice corresponds to a (huge) number of 
sweeps on the non-renormalized lattice, in fact to the 
number needed to equilibrate on the length scale 2 iNrt . 

Memory and Rejuvenation - We use the standard 
temperature cycling protocol and measure a quantity 
similar to the ac-susceptibility defined as |15| 



X(w,*) 



l-Q(t+2£ t) 
T 



(4) 



where Q(t,t') = Y*(Si(t)Si(tf)) /N. (Note that Q is a 
dynamical generalization of the q previously discussed.) 
The period 2tt/cj of our ac-field is 16 MCS. Every MCS 
updates all spins once. An alternative choice is to 
sweep the bonds, updating their end spins as in [lif : 
we have checked that the results are hardly affected by 
the method used. The simulations were done on Migdal- 
Kadanoff lattices with four generations using < NRG < 
15. In Fig. H|we show the isothermal x at T, at T — AT, 
and also x for a T — > T— AT — > T temperature cycle. We 
used T — 0.7 and AT = 0.05. Since we calculate renor- 
malized couplings at T and T — AT from the same set of 
bare couplings, they are highly correlated when NRG is 
small. However, their correlation vanishes for large NRG 
due to temperature chaos. The direction of each spin at 
t = is chosen randomly with equal probability, corre- 
sponding to a quench from an infinitely high temperature 
at an infinite rate. We hereafter denote x with a T-cycle 
as Xcycic and the isothermal \ at T as Xiso(T). 

For small NRG, Xcycic is below Xiso(T — AT) in the 
second stage, as illustrated in Fig. EJa) . This means that 
the former is older than the latter and that equilibration 
is accelerated with increasing temperature; there is no 
rejuvenation here. On the other hand, Xcycic and Xiso{T) 
almost overlap in the third stage. This means that the 
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FIG. 4: Isothermal x(^T) at T (broken line), at T - AT 
(solid line), and x(^,t) with a negative T-cycle (crosses) for 
NRG = 5, 8, 11 and 15. The average is from 10 4 samples. 



effective aging time i e ff, that is the equivalent time the 
system would have had to spend at T rather than at 
T — AT to return to the same curve, is close to the ac- 
tual window time t W 2 spent at T — AT. It is often ob- 
served in experiment that t e g becomes for large AT, 
corresponding to perfect memory. In our simulations, AT 
is relatively small and so we get partial memory for all 
NRG. This general trend of no rejuvenation yet memory 
with t c ff « t w2 arises until NRG « 7. 

Fig. 0Jb) shows that a sign of rejuvenation appears 
around NRG « 8, i.e., Xcycic is above Xiso(T — AT) at 
the beginning of the second stage. However, at later times 
of this second stage, the cycling curve goes below the 
Xiso(T — AT) curve. The crossing of these curves has 
been observed experimentally [l7| , and will be examined 
in the discussion section. Finally at the beginning of the 
third stage, the cycling data has significant deviations 
from the isothermal data. The conclusion for this figure 
is that signs of rejuvenation emerge on smaller length 
scales than expected because the linear correlation co- 
efficient is still large when NRG = 8, C DW = 0.965. 
(£(0.7, 0.65) k 2 12 in this case.) This result is consistent 
with that in |l8j | where rejuvenation was observed in the 
3-dimensional EA spin glass model when reversing the 
sign of 5% of the couplings. We have also compared Xcycic 
in the second stage to Xiso 

(T- AT) shifted to the right by 
i w i, the time of the first stage, and found that perfect re- 
juvenation (i.e., complete overlap of the two curves) arises 
only when NRG > 13 where the effective couplings at the 
two temperatures are very decorrelated ((7 DW < 0.10). 

On general grounds, one may expect i e ff to be smaller 
than t W 2 because the temperature is lower in the sec- 
ond stage. However, when NRG = 10, 11 and 12, quite 
surprizingly, we find that the cycling data in the third 
stage are slightly below the isothermal data, meaning that 
t c s > t W 2', this is illustrated in Fig.^Jc). 

Finally, Fig. [Jd) shows the case NRG = 15. The ef- 
fective couplings at the two temperatures are now com- 
pletely decorrelated. As a consequence, strong relaxation 
is observed not only in the second stage but also in the 
third stage. Now an interesting question is whether mem- 
ory remains or not. We have thus compared x( w > t) m the 
third stage to that in the first stage, and found that the 
former is clearly older than the later. This is consistent 
with the prediction of ref. |4| that memory survives even 
if there is complete temperature chaos, i.e., i(T,T') = 0. 

Now for a few remarks. First, we have also performed 
positive T-cycling simulations, going from T = 0.7 to 
T + AT = 0.75 in the second stage. The qualitative 
behavior is similar, the main difference being that equili- 
bration is accelerated by the cycling. In particular, when 
NRG is not too large, x(w,t) in the third stage and at 
large times is below the isothermal data. This kind of be- 
havior has been observed in glassy systems like polymer 
glasses 0, but not yet in spin glasses. Second, we have 
used the same NRG at T and T - AT but really NRG 
should decrease with temperature because the ordering is 
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then slower. A temperature dependence of NRG will re- 
duce t e g which is unexpectedly large in our simulations. 
Moreover, it will cause separation of length scales, an 
important ingredient for memory and rejuvenation |20j. 

Discussion and conclusions — One of our main find- 
ings in this work is that a signal of rejuvenation arises 
on scales £r much smaller than the equilibrium overlap 
length £(T,T'). (In Fig. 0] rejuvenation transpires even 
though £(T,T')/£r « 2 4 .) How can one interpret this 
result? Within the droplet picture, a small fraction of 
droplets of size I are fragile |3( against temperature vari- 
ation even when I <C £(T, T'). In our case, we equilibrate 
out to scales L 



beyond Z eq , 



one has domain walls, the 



positions of which are time dependent and sensitive to 
temperature changes. The strong relaxation of Xcycic we 
see in the second stage can thus be interpreted as the re- 
ordering of the spins either inside fragile droplets or on 
the boundaries of the (out of equilibrium) domain walls. 
However, it is also possible to interpret the rejuvenation 
we see without appealing to temperature chaos. Indeed, 
in the picture of |2Qj, there is no chaos; nevertheless, tem- 
perature cycling modifies the Boltzmann weights, leading 
to rejuvenation on short length scales. 

A second surprizing feature we found was the crossing 
of Xcycio and X iso(T - AT). (See Fig. Interest- 
ingly, such a crossing behavior has been seen in experi- 
ments ll7|- Do the different theoretical frameworks pre- 
dict such a crossing? In the droplet picture, rejuvenation 
in Fig. Hfb) is attributed to fragile droplets. However, 
the equilibrium state is still robust in most regions be- 
cause the occurrence of such droplets is rare at this length 
scale, I — 2 8 . Moreover, if we compare the equilibrated 
length scale at t w i in the T-cycling case with that in the 
isothermal case of T — AT, the former is larger than the 
latter because equilibration is accelerated with increas- 
ing temperature. Therefore, x C ycic eventually goes below 
Xiso(T — AT) after the re-ordering of fragile droplets pro- 
gresses sufficiently. The picture of |20| also gives natu- 
ral interpretation of the crossing. First, the positions of 
pinned domain walls are determined hierarchically: the 
structure at large scales is associated with large energies, 
that at small scales is associated with small energies. Sec- 
ond, one reaches the correct large scale structure faster by 
aging at T rather than at T — AT since barriers are over- 
come more easily. (It is important that the large scale 
structure be the same at the two temperatures.) As a 
result, after transient reconstructions on smaller length 
scales (rejuvenation), Xcycic will cross Xiso(T — AT). 

Last, our system exhibits memory which persists even 
when the equilibrated scale is much larger than £(T,T'). 
This result is completely compatible with the predic- 
tion by Yoshino et al. [4J. They showed that even if 
£(T,T') « 0, the equilibration in the second stage just 
injects uncorrelated short-range noise into the long-range 
ordering developed during the first stage; memory is then 



retrieved in the third stage after transients associated 
with removing this noise. 
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